activ learn direct queri construct charl ling jun du activ learn hold kei solv data scarciti problem supervis learn lack label data label data costli process activ learner request label select instanc reduc label work dramat previou work activ learn pool base pool unlabel exampl learner select exampl pool queri label type activ learn weak paper propos activ learn algorithm construct exampl directli queri label studi specif activ learner base decis tree algorithm gener activ learner work base learn algorithm restrict exampl queri method shown queri fewer exampl reduc predict error quickli cast doubt us pool pool base activ learn method easili adapt work pool unlabel exampl 